Data transmission device and method

ABSTRACT

A data transmission device for generating a plurality of compressed/encoded data of different bit rates from a single video signal, whereby unevenness in the amount of generated data can be easily reduced. A synchronizing signal detection section detects a synchronizing signal from the input video signal and supplies the detected signal to a timing control section. Compressing/encoding sections compress/encode the same video signal input thereto to generate data streams of different bit rates. The timing control section controls the compressing/encoding sections in accordance with the synchronizing signal detected by the synchronizing signal detection section such that timings for starting compression/encoding processes in the compressing/encoding sections are offset in units of frame. A multiplexing section generates fragmented packets carrying the individual data streams in accordance of amounts of data generated per unit time by the respective compressing/encoding sections, and sequentially transmits the fragmented packets at equal intervals within the unit time.

BACKGROUND OF THE INVENTION

(1) Field of the Invention

The present invention relates to a data transmission device and methodfor generating a plurality of compressed/encoded data of different bitrates from a single video signal and simultaneously transmitting thegenerated data onto a network, and more particularly, to a datatransmission device and method applicable to real-time transmission ofsuch compressed/encoded data.

(2) Description of the Related Art

Recent image compression/encoding techniques such as MPEG (MovingPicture Experts Group) have made it easy to deliver moving picture dataover networks. However, in the case of delivering such data through theInternet in particular, the delivered data may possibly be transferredvia analog telephone lines or ISDN (Integrated Services Digital Network)lines, and broadband communication is not necessarily available to everyrecipient. Under the present circumstances, therefore, it is necessarythat the resolution be lowered or the compression ratio be increased topermit data to be delivered at a relatively low bit rate.

In view of this, a moving picture data delivery scheme has beenconceived wherein two types of data, that is, one for delivery to arelatively broadband network, such as an intranet in a corporation, andthe other for delivery to a relatively narrowband network, such as theInternet, are generated from a single video source and are deliveredsimultaneously. For example, for a broadband network, a data streamcompressed/encoded according to MPEG-2 is delivered at a bit rate ofabout 6 Mbps, and for a narrowband network, a data streamcompressed/encoded according to MPEG-4 is delivered at a bit rate ofabout 100 kbps.

Heretofore, when generating a plurality of data streams for delivery atdifferent bit rates from a single video source, encoders equal in numberto the data streams to be generated are used to encode data distributedfrom the video source. Alternatively, a transcoder or the like is usedto decode the data stream for broadband delivery and then to againencode the decoded data stream to obtain a data stream for narrowbanddelivery.

However, the delivery of moving picture data has now become sopopularized that there is a strong demand for reduction in cost ofdeliverer-side systems as well as in size of such systems to saveinstallation space. Also, in recent years, real-timeliness orsimultaneity of delivered data is often given importance especially incases where the water levels of rivers or dams, roads, etc. aremonitored from a remote location or a conference or a concert isbroadcast live. Accordingly, there has been proposed an idea ofincorporating a plurality of encoder engines into a single encoder, togenerate a plurality of data streams of different bit rates and deliverthe generated data streams simultaneously.

Meanwhile, in the case of data which has been compressed/encoded byusing inter-frame prediction as in MPEG, an appreciable difference oftenoccurs between the data amount of a picture which can be decoded by itsown data only and the data amount of a picture which has been generatedusing the inter-frame prediction. Accordingly, the processing loadgreatly varies during the image encoding/decoding process, and also whensuch data is transmitted over a network, an actual amount of transmitteddata can momentarily rise well above the average bit rate.

As regards techniques for generating data by encoding individual objectsof image and then multiplexing the encoded objects, there has beenproposed a method in which the start timings for encoding objects areoffset in accordance with the ranges of variations in the amount of codegenerated per frame for the individual objects, to smooth variation inthe amount of generated code as well as in the processing load (e.g.,Japanese Unexamined Patent Application No. H10-023427 (cf. ParagraphNos. [0037] to [0051], FIG. 5)).

Thus, the compression/encoding techniques using the inter-frameprediction as in MPEG are associated with a problem that the amount ofgenerated code varies over a wide range, as mentioned above. Especiallyin the case where a plurality of compressed/encoded data of differentbit rates are generated from a single video source and are deliveredsimultaneously, the amount of generated code varies over an even widerrange, giving rise to a problem that data cannot be received properlywhere the amount of data transmitted onto the network momentarilyincreased.

FIG. 9 illustrates variation in the amount of data observed when aplurality of compressed/encoded data of different bit rates aresimultaneously delivered, wherein FIG. 9(A) shows exemplary arrangementsof pictures in respective data streams generated according to MPEG-2,and FIG. 9(B) is a graph showing a total amount of data generated withrespect to each picture.

In FIG. 9(A) is illustrated the case where two data streams A and B ofdifferent bit rates are generated from a single video source by twoencoders. A data stream encoded according to MPEG-2 (or MPEG-1)comprises an I picture encoded in a closed manner within a frame, a Ppicture encoded using forward prediction, and a B picture encoded usingbidirectional prediction. The data streams A and B shown in FIG. 9(A)have a general picture arrangement in which one I or P picture ispreceded and followed by two B pictures. A GOP (Group Of Pictures) is aunit that allows playback of the data stream in the middle, and one GOPalways includes one or more I pictures. In the illustrated example, afixed number of pictures constitutes one GOP.

Since the I picture is generated by closed encoding within a frame, itsdata amount is noticeably large, compared especially with the B picture.In a data stream having a picture arrangement as shown in FIG. 9(A), thedata amount of I pictures accounts for nearly 1/3 of the total amount ofthe data stream.

In the illustrated example, every twelve pictures include one I picture,and therefore, in terms of an average data delivery rate per second,half of the amount of data delivered during a period of 11/12 second isdelivered within the remaining period of 1/12 second at a time. Wherethe data stream has an average bit rate of 6 Mbps, for example, there isa possibility that data is generated at an instantaneous rate of 24 Mbpswhen an I picture is generated. Further, since the bit rate of 24 Mbpsis a value that applies to the case where data is delivered uniformlyduring a period of 1/12 second, data can possibly be transmitted at aneven higher rate if the data is transmitted at a time as soon as it isgenerated.

Also, in the case where multiple data streams are encoded simultaneouslyby multiple encoder engines incorporated in a single encoder, theencoding processes are usually started at the same time and I, B and Ppictures are generated at respective identical positions, as shown inFIG. 9(A). Consequently, at the timing when I pictures are generated forthe respective data streams, the total amount of generated data sharplyincreases for a moment. For example, where the average bit rates of thedata streams A and B are 6 Mbps and 3 Mbps, respectively, the datageneration rate reaches 36 Mbps (=24 Mbps+12 Mbps) at its peak. Suchextreme unevenness in the amount of generated data instantaneouslyincreases the load on the network for transmitting data and causespacket loss etc.

It is possible to generate encoded data in such a manner as to reduceunevenness in the amount of generated data. In this case, however, it isnecessary that the encoder be provided therein with a large-capacitybuffer to encode data while temporarily storing a considerable amount ofdata. As a result, the transmission of data is delayed behind theoriginal video, thus impairing the simultaneity. Also, complex controlis required, which leads to an increase in cost of the device.

SUMMARY OF THE INVENTION

The present invention was created in view of the above circumstances,and an object thereof is to provide a data transmission device whichpermits unevenness in the amount of generated data to be reduced withease in the case where a plurality of compressed/encoded data ofdifferent bit rates are generated from a single video signal.

Another object of the present invention is to provide a datatransmission method which permits unevenness in the amount of generateddata to be reduced with ease in the case where a plurality ofcompressed/encoded data of different bit rates are generated from asingle video signal.

To achieve the first object, there is provided a data transmissiondevice for generating a plurality of compressed/encoded data ofdifferent bit rates from a single video signal and simultaneouslytransmitting the compressed/encoded data onto a network. The datatransmission device comprises a synchronizing signal detection sectionfor detecting a synchronizing signal from the video signal inputthereto, a plurality of compressing/encoding sections forcompressing/encoding the video signal to generate data streams ofdifferent bit rates, respectively, a timing control section forcontrolling the compressing/encoding sections in accordance with thedetected synchronizing signal such that timings for startingcompression/encoding processes in the compressing/encoding sections areshifted from one another in units of frame, and a multiplexing sectionfor sequentially multiplexing the data streams generated by therespective compressing/ encoding sections and transmitting themultiplexed data onto the network.

Also, to achieve the second object, there is provided a datatransmission method for generating a plurality of data streams ofdifferent bit rates by compressing/encoding a single video signal andfor simultaneously transmitting the data streams onto a network. Thedata transmission method comprises the step of detecting a synchronizingsignal from the input video signal, the step of shifting start timingsfor compression/encoding processes corresponding to the generation ofthe respective data streams from one another in units of frame inaccordance with the detected synchronizing signal, and the step ofgenerating fragmented packets carrying the individual data streams inaccordance with amounts of data generated per unit time by therespective compression/encoding processes, and transmitting thefragmented packets onto the network at equal intervals within the unittime.

The above and other objects, features and advantages of the presentinvention will become apparent from the following description when takenin conjunction with the accompanying drawings which illustrate preferredembodiments of the present invention by way of example.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1(A) to 1(C) illustrate the principle of the present invention;

FIG. 2 is a diagram showing a system configuration of an image deliverysystem to which a data transmission device of the present invention isapplicable;

FIG. 3 is a block diagram illustrating functions of a data transmissiondevice according to one embodiment of the present invention;

FIG. 4 is a diagram showing a configuration of a signal system forcontrolling operation start timings for individual encoders;

FIGS. 5(A) to 5(E) are a time chart showing waveforms of signals sent tothe individual encoders from a video timing section;

FIGS. 6(A) and 6(B) illustrate arrangements of pictures in respectivegenerated data streams and amounts of generated data;

FIGS. 7(A) and 7(B) illustrate data amounts of respective pictures in agenerated data stream and packets carrying the pictures;

FIG. 8 is a flowchart illustrating a process performed on each of thedata streams by a packet generating section; and

FIGS. 9(A) and 9(B) illustrate variation in data amount observed when aplurality of compressed/encoded data of different bit rates aredelivered simultaneously.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present invention will be hereinafter described withreference to the drawings.

FIG. 1 illustrates the principle of the present invention.

A data transmission device 1 of the present invention is a device forcompressing/encoding a video signal from a camera or the like anddelivering a generated data stream in real time onto a network 2. Inthis case, since networks configured up to recipients can be eitherbroadband or narrowband, a plurality of data streams of different bitrates are generated from a single video source, so as to match with thedifferent bands, and are delivered simultaneously.

As shown in FIG. 1(A), the data transmission device 1 comprises asynchronizing signal detection section 11 for detecting a synchronizingsignal from a video signal input thereto, compressing/encoding sections12 a and 12 b for compressing/encoding the input video signal togenerate data streams of different bit rates, respectively, a timingcontrol section 13 for controlling the compressing/encoding sections 12a and 12 b such that timings for starting compression/encoding processesin the compressing/encoding sections 12 a and 12 b are shifted from eachother in units of frame, and a multiplexing section 14 for sequentiallymultiplexing the data streams generated by the respectivecompressing/encoding sections 12 a and 12 b and transmitting themultiplexed data onto the network 2. The example shown in FIG. 1includes only two compressing/encoding sections, but three or morecompressing/encoding sections may be provided.

The synchronizing signal detection section 11 detects a synchronizingsignal necessary for the detection of start timing for a frame or fieldor horizontal scanning, demodulation of chrominance signals, etc., fromthe input video signal. In the case where NTSC (National TV StandardsCommittee) composite signal is input as the video signal, for example,vertical synchronizing signal, horizontal synchronizing signal, colorsynchronizing (color burst) signal, etc. are detected as thesynchronizing signal. The detected synchronizing signal is supplied tothe timing control section 13.

Using the thus-supplied synchronizing signal, the timing control section13 controls the timings for starting the compression/encoding processesin the respective compressing/encoding sections 12 a and 12 b. In thiscase, the timings for starting the compression/encoding processes in thecompressing/encoding sections 12 a and 12 b are controlled so as to beshifted from each other in units of frame.

Under the control of the timing control section 13, thecompressing/encoding sections 12 a and 12 b compress/encode the inputvideo signal at respective different bit rates, to generate movingpicture data streams.

The multiplexing section 14 sequentially packetizes and multiplexes thedata streams generated by the compressing/encoding sections 12 a and 12b, and transmits the multiplexed data onto the network 2. Also, themultiplexing section 14 carries out control such that fragmented packetsare generated in accordance with the amount of data generated by theindividual compressing/encoding sections 12 a and 12 b and aretransmitted at equal intervals within a unit time.

The compressing/encoding sections 12 a and 12 b are provided in the datatransmission device 1 correspond in number to data streams to begenerated and are operated in parallel. Thus, although there is a“shift” between the start timings for generating the respective datastreams, no delay occurs in the subsequently generated data streams,making it possible to deliver image with remarkably enhancedsimultaneity.

Operation of the data transmission device 1 will be now described on theassumption that NTSC (National TV Standards Committee) composite signalis input as the video signal.

The video signal input to the data transmission device 1 is supplied tothe two compressing/encoding sections 12 a and 12 b as well as to thesynchronizing signal detection section 11. Each of thecompressing/encoding sections 12 a and 12 b receives, as the videosignal, a digital video signal which has been obtained by processing thevideo signal in an A/D conversion section etc., not shown, and starts tocompress/encode the video signal in accordance with a control signalfrom the timing control section 13.

The compressing/encoding sections 12 a and 12 b generate data withdifferent compression ratios and different resolutions, but pictures aregenerated at the same intervals. In the case where thecompression/encoding is performed using inter-frame prediction, thearrangements of pictures in the data streams generated by the respectivecompressing/encoding sections 12 a and 12 b are usually the same.

Thus, by shifting the start timings for the compression/encodingprocesses from each other in units of frame, the picture arrangements ofthe data streams generated by the respective compressing/encodingsections 12 a and 12 b can be made to differ from each other. As aconsequence, the data amount of generated picture sharply increases atdifferent timings between the data streams, whereby variation in theoverall data amount of the generated data streams can be smoothed.

On the other hand, the synchronizing signal detection section 11detects, as the synchronizing signal, a vertical synchronizing signal, acolor synchronizing signal, etc. from the video signal, and outputs thedetected signals to the timing control section 13. The timing controlsection 13 acquires frame (or field) start timing from the verticalsynchronizing signal input thereto, and also generates a chrominancesubcarrier signal synchronized with the color synchronizing signal. Thechrominance subcarrier signal is used as a reference signal whenseparating chrominance signals in the input video signal, etc.

In the case of NTSC signal, the phase of the chrominance subcarriersignal is inverted every two fields (i.e., every frame). Accordingly,the timing control section 13 can easily acquire the shift amountcorresponding to one frame by detecting the phase of the chrominancesubcarrier signal at the frame start timing, as shown in FIG. 1(B), andcan provide the compressing/encoding sections 12 a and 12 b with thestart timings for their respective compression/encoding processes.Specifically, when the frame start timing synchronizes with the risetiming of the chrominance subcarrier signal, the compressing/encodingsection 12 a is instructed to start the process, and when the framestart timing thereafter synchronizes with the fall timing of thechrominance subcarrier signal, the compressing/encoding section 12 b isinstructed to start the process. This serves to smooth variation in thetotal data amount of the generated data streams.

The generated data streams are output to the multiplexing section 14. Asshown in FIG. 1(C), when the amount of data generated per unit time byeither of the compressing/encoding sections 12 a and 12 b is too large,the multiplexing section 14 generates fragmented packets carrying suchdata. For example, a reference value is set for the data amount to becarried by one packet, and if the amount of data corresponding to onepicture (i.e., one frame) in either of the data streams exceeds thereference value, the picture data is fragmented into a plurality ofpackets. The thus-fragmented packets are transmitted at equal intervalswithin a unit time.

The packet transmission control described above makes it possible tofurther smooth variation in the amount of data transmitted to thenetwork 2, to lower the peak bit rate of transmitting data, and toreduce the transmission load. The reference value specifying the dataamount to be carried by one packet may be set as desired, taking accountof the performance of the data transmission device 1 itself and thecapacity of the network 2.

As described above, according to the present invention, thesynchronizing signal detected from the input video signal is used sothat the timings for starting the compression/encoding processes in therespective compressing/encoding sections 12 a and 12 b may be shiftedfrom each other in units of frame. Consequently, a sudden increase inthe amount of generated data takes place at scattered timings in therespective data streams, and since variation in the total amount oftransmitting data can be smoothed as a result, packet loss etc. can beprevented from occurring due to increase in the network load.

Especially in the case where NTSC composite signal is used as the input,control timings for the compressing/encoding sections 12 a and 12 b canbe derived with ease from the vertical synchronizing signal and colorsynchronizing signal detected from the input video signal. It istherefore possible to control the start timings for thecompression/encoding processes without the need to use a counter circuitetc. for obtaining a shift amount of frame start timings, for example,and accordingly, the device can be reduced in cost and size.

Further, in accordance with the data amount of the data stream generatedby each of the compressing/encoding sections 12 a and 12 b, themultiplexing section 14 generates fragmented packets carrying the datastream, and transmits the fragmented packets at equal intervals, wherebyvariation in the amount of data transmitted onto the network 2 can bemade even smoother. In this manner, the present invention uses the starttiming control for the compression/encoding processes in combinationwith the packetization control for generated data, whereby the effect ofsmoothing variation in the amount of data transmitted onto the network 2can be enhanced without impairing simultaneity of transmitted data.

In the example described above, the timings for starting thecompression/encoding processes are shifted from each other by one frame,but the start timings may be shifted from each other by two or moreframes. Also, where three or more data streams of different bit ratesare generated simultaneously, the process start timings of therespective compressing/encoding sections may be sequentially shifted inunits of frame. In this case, however, the shift amount is preferablyset to one frame, in order to more securely smooth variation in theamount of generated data.

An embodiment of the present invention will be now described in detail.In the following description, the invention is applied, by way ofexample, to a system for delivering image to recipients connected to anintranet such as a LAN (Local Area Network) in a corporation, or to theInternet.

FIG. 2 shows a system configuration of an image delivery system to whichthe data transmission device of the present invention can be applied.

The image delivery system shown in FIG. 2 generates data streams fromimages acquired by cameras 110 a and 120 a and delivers the generateddata streams in real time to recipients through networks. The imagedelivery system is used, for example, to monitor the water levels ofrivers or dams, roads, etc. from a remote location or to broadcast aconference or a concert live.

The image delivery system comprises data transmission devices 110 and120 to which the cameras 110 a and 120 a are connected, respectively,and receiving terminals 210 and 220 for receiving moving picture datastreams delivered from the data transmission devices 110 and 120. Thedata transmission devices 110 and 120 are connected through an intranet310 to the Internet 320. The receiving terminal 210 is connected to theintranet 310, while the receiving terminal 220 is connected to theInternet 320 through, for example, a telephone line, not shown.

The cameras 110 a and 120 a each acquire an image and output theacquired image as NTSC composite signal. The data transmission devices110 and 120 compress/encode the image signals from the respectivecameras 110 a and 120 a in accordance with MPEG, and transmit thecompressed/encoded data onto the intranet 310. The receiving terminals210 and 220 have the function of receiving the thus-transmitted datastreams through the intranet 310 and the Internet 320, respectively,decoding and displaying the data, and each comprise, for example, acomputer such as a PC (Personal Computer).

The system may include larger numbers of data transmission devices andreceiving terminals than illustrated. However, the data transmissiondevices need to be connected to the intranet 310.

The intranet 310 is a network that warrants high-speed datatransmission/reception as a whole, compared with the Internet 320. Thedata transmission device 110 generates, based on a single video sourcefrom the camera 110 a, data streams of different bit rates matching therespective transmission bands of the intranet 310 and Internet 320, andtransmits the generated data streams. This is the case with the datatransmission device 120.

Accordingly, of the data streams delivered from the data transmissiondevice 110, for example, a data stream A with a relatively high bit rateof several Mbps can be received properly by the receiving terminal 210,and a data stream B with a relatively low bit rate of several hundredkbps can be received properly by the receiving terminal 220, as shown inFIG. 2. Each of the data transmission devices 110 and 120 transmits databy multicasting, for example, and the receiving terminals 210 and 220can select the bit rate at which they are to receive the data stream.

Processing functions of the data transmission device 110, as an example,will be now described. FIG. 3 is a block diagram illustrating thefunctions of the data transmission device 110.

As shown in FIG. 3, the data transmission device 110 comprises an A/Dconversion section 111, a sync detection section 112, a low-pass filter113, a Y/C separation section 114, a filtering/scaling section 115, anoutput formatting section 116, encoders 117 a and 117 b, a video timingsection 118, and a packet generating section 119.

The A/D conversion section 111 samples the NTSC composite signaltransmitted from the camera 110 a and converts the signal to a digitalvideo signal. The sync detection section 112 detects a verticalsynchronizing signal, a horizontal synchronizing signal and a colorsynchronizing signal from the digital video signal converted by the A/Dconversion section 111, and outputs the detected signals to the videotiming section 118.

The low-pass filter 113 passes only low-frequency components of thevideo signal from the A/D conversion section 111, to thereby removenoise. The Y/C separation section 114 separates the video signalsupplied from the low-pass filter 113 into a luminance signal and colordifferential signals.

The filtering/scaling section 115 performs resolution conversion andeffective image area cropping on the video signal which has beensubjected to the Y/C separation. The output formatting section 116buffers, on a frame-by-frame basis, the video signal supplied from thefiltering/scaling section 115, and provides a non-interlaced videosignal.

The encoders 117 a and 117 b each receive the video signal from theoutput formatting section 116 and, in accordance with respectivepredetermined resolutions and compression ratio settings,compress/encode the video signal according to MPEG-2. In this case, theencoder 117 a generates a data stream A with a relatively high averagebit rate of several Mbps, for example, and the encoder 117 b generates adata stream B with a relatively low average bit rate of several hundredkbps, for example. The encoders 117 a and 117 b generate pictures inresponse to the same field start signal from the video timing section118, as described later, and accordingly, no delay of data occurs as aresult of the compression/encoding processes by these encoders, thuspermitting very nearly real-time generation of data with respect to theoriginal video signal.

The video timing section 118 receives the synchronizing signals detectedby the sync detection section 112 and controls the operation timings ofthe encoders 117 a and 117 b, etc. Using the color synchronizing signalfrom the sync detection section 112, the video timing section 118generates a 14.318-MHz synchronizing signal, which is a reference signalfor the synchronization of video signal within the data transmissiondevice 1. This synchronizing signal is used as a sampling frequency bythe A/D conversion section 111, for example, and also the vertical andhorizontal synchronizing signals from the sync detection section 112 aresynchronized with this synchronizing signal. Further, the video timingsection 118 generates a chrominance subcarrier signal (3.5785 MHz)synchronized with this synchronizing signal.

The video timing section 118 generates field and frame start signalsbased on the vertical synchronizing signal, as described later, and alsooutputs the chrominance subcarrier signal in order to control the framestart timings and compression/encoding start timings of the individualencoders 117 a and 117 b by means of these signals. A detailedconfiguration for controlling such operation start timings will bedescribed with reference to FIG. 4.

On receiving the data streams generated by the respective encoders 117 aand 117 b, the packet generating section 119 assembles the data into IP(Internet Protocol) packets, multiplexes the packets, and then sends themultiplexed packets onto the intranet 310.

FIG. 4 illustrates the configuration of a signal system for controllingthe operation start timings of the encoders 117 a and 117 b.

To control the operation start timings of the encoders 117 a and 117 b,the video timing section 118 outputs the field start signal Sfd, framestart signal Sfm and chrominance subcarrier signal Sc.

The field start signal Sfd is a pulse signal synchronized with risetiming of the vertical synchronizing signal, and provides the encoders117 a and 117 b with field start timing.

The frame start signal Sfm is output once for every two pulses of thefield start signal Sfd and is input to two AND gates 118 a and 118 b.The other input terminal of the AND gate 118 a is input with thechrominance subcarrier signal Sc, and the other input terminal of theAND gate 118 b is input with a phase-inverted signal of the chrominancesubcarrier signal Sc. Output signals of the AND gates 118 a and 118 bare input to the encoders 117 a and 117 b, respectively, therebyproviding the encoders 117 a and 117 b with their respectivecompression/encoding start timings.

FIG. 5 is a time chart showing the waveforms of signals transmitted tothe encoders 117 a and 117 b from the video timing section 118.

In an NTSC system, the field period and the chrominance subcarriersignal maintain a relationship such that they are synchronized once inevery four fields, and the phase of the chrominance subcarrier signal isinverted every two fields (i.e., every frame). Accordingly, if timingT501 at which a pulse of the frame synchronizing signal Sfm is output asshown in FIG. 5(A) coincides with rise timing of the chrominancesubcarrier signal Sc shown in FIG. 5(B), the timing T502 at which thenext pulse of the frame synchronizing signal Sfm is output coincideswith fall timing of the chrominance subcarrier signal Sc.

Thus, when the compressing/encoding sections 12 a and 12 b areinstructed to start their processes, the start signal Sa is output fromthe AND gate 118 a at the timing T501 when the frame start signal Sfm isoutput for the first time after the reception of the instruction, asshown in FIG. 5(C). In response to the start signal Sa, the operation ofthe encoder 117 a is started.

The AND gate 118 b is input with the phase-inverted signal of thechrominance subcarrier signal Sc, and at the next frame start timingT502, rise timings of the phase-inverted signal and frame start signalSfm coincide with each other, as shown in FIG. 5(D). Thus, the startsignal Sb is output from the AND gate 118 b, as shown in FIG. 5(E), andthe operation of the encoder 117 b is started. As a result, theoperation start timing of the encoder 117 b is delayed by one frame fromthat of the encoder 117 a.

In the illustrated example, the frame start signal Sfm is used forcomparison with the phase of the chrominance subcarrier signal Sc, butthe field start signal Sfd may be used instead.

FIG. 6 illustrates picture arrangements of individual data streams andamounts of data generated when the operation start timings arecontrolled in the manner described above.

The data streams A and B generated by the encoders 117 a and 117 b,respectively, have a picture arrangement such that one I or P picture ispreceded and followed by two B pictures, as shown in FIG. 6(A). Also, inboth data streams A and B, one GOP includes the same number of pictures.

Since the timing for starting the compression/encoding process in theencoder 117 b is delayed by one frame from the operation start timing ofthe encoder 117 a, the individual pictures appearing in the generateddata streams A and B are shifted from each other by one frame, as shownin FIG. 6(A). Thus, the I or P pictures of the data streams A and Binvariably appear at different positions.

FIG. 6(B) shows the amount of data generated for each picture in theindividual data streams A and B. As seen from the figure, in both datastreams A and B, the data amount of I picture is especially large,compared with the data amount of B picture. However, since the Ipictures of the data streams A and B appear at different positions,variation in the total amount of data generated per frame in the twodata streams can be smoothed, compared with the case where the Ipictures are generated at the same time.

The timings for starting the respective compression/encoding processesare controlled by the video timing section 118 in the aforementionedmanner, whereby variation in the total data amount of the data streamsgenerated by the encoders 117 a and 117 b can be smoothed. To this end,the video timing section 118 uses control signals which are generatedbased on the synchronizing signals included in the original videosignal. The control signals used in this case are the synchronizingsignals which are generated also in conventional devices to cause theencoders 117 a and 117 b to start processing the digital video signalconverted from an input analog video signal. Therefore, theaforementioned timing control for the compression/encoding processes canbe implemented by simply adding circuitry including AND gates, and thuswith a simple structure, whereby increase in the cost of the device andin the installation space therefor can be minimized.

The following describes how variation in the amount of transmitting datais smoothed by the packet generating section 119. FIG. 7 illustrates thedata amounts of respective pictures generated in the data stream A or Band packets carrying the pictures.

FIG. 7(A) shows the data amount of each picture in the data stream Agenerated by the encoder 117 a, by way of example. As seen from thefigure, the I picture shows an extremely large data amount within thedata stream, as compared with the B or P picture. Thus, the packetgenerating section 119 sets a reference value D1 as an upper limit forthe data amount to be carried by one packet. In the figure, D2 indicatesa data amount which is twice the reference value D1.

In the illustrated example, the data amounts of I pictures are greaterthan the reference value D1, and in such cases, the packet generatingsection 119 fragments the picture data into a plurality of packets. FIG.7(B) shows the amounts of data carried by respective packets and thetimings for transmitting the packets.

As shown in FIG. 7(B), a picture whose data amount does not exceed thereference value D1 is contained in one packet and transmitted at theframe period. On the other hand, for a picture whose data amount islarger than the reference value D1, an amount of picture datacorresponding to the reference value D1 as the upper limit is containedin one packet while the remaining data is contained in a separatepacket(s). In the case of the I pictures shown in the figure, their dataamount exceeds twice the reference value D1, and accordingly, each Ipicture is fragmented and contained in three packets.

The packets fragmented in this manner are sequentially transmitted atrespective timings which are obtained by equally dividing the period upto the next packet transmission timing for transmitting the subsequentpicture by the number of generated or fragmented packets. This permits alarge amount of I picture data to be transmitted in a distributed mannerwithin the transmission period allocated to one picture, making itpossible to prevent packet loss etc. from being caused due to suddenincrease in the transmission load on the network (intranet 310).

FIG. 8 is a flowchart showing a process performed on each of the datastreams A and B by the packet generating section 119.

The packet generating section 119 is provided, for example, with buffersfor receiving input data from the encoders 117 a and 117 b,respectively. In Step S801, data corresponding to one frame, that is,one picture, is read from the buffer, and in Step S802, the data amountof the picture thus read out is detected.

Then, in Step S803, the detected data amount is compared with thepacketization reference value D1, to calculate the number of packets tobe generated. If the detected data amount exceeds n times the referencevalue D1 and at the same time is smaller than or equal to (n+1) timesthe reference value, (n+1) is set as the number of packets to begenerated to carry the data.

In Step S804, an interval for transmitting the fragmented packets iscalculated from the calculated number of packets. In the case where(n+1) has been set as the number of packets as mentioned above, a valueobtained by dividing 1/30 second, which is the transmission intervalallocated to one picture, by the number of packets, (n+1), is set as theinterval for transmitting the fragmented packets. The packet generatingsection 119 is also provided with a timer for counting the packettransmission interval, and sets the timer to count the calculatedtransmission interval.

Subsequently, in Step S805, predetermined header information and thelike are affixed to the data corresponding in amount to the referencevalue D1 to generate a first UDP (User Datagram Protocol) packet, andtransmits the packet at predetermined frame synchronization timing ontothe intranet 310.

In Step S806, it is determined whether or not all of the packetscorresponding to one picture have been transmitted. If all of thepackets have been transmitted, the process for this picture is ended,whereupon the process is again executed from Step S801 to transmit thenext picture. On the other hand, if there is a packet or packets whichare not transmitted yet, the process proceeds to Step S807.

In Step S807, the timer count is monitored to wait until a time periodcorresponding to the transmission interval set in Step S804 elapses.Upon lapse of the set time period, the process returns to Step S805 togenerate and transmit the next packet. Steps S805 to S807 are repeatedthereafter until transmission of all packets corresponding to onepicture is completed.

The process shown in FIG. 8 is a process performed on one data stream.With respect to the packets corresponding to the two pictures of therespective data streams A and B, the packet generating section 119continuously transmits the packets at the timing of the same frameperiod. Because of the process start timing control carried out by thevideo timing section 118, an I picture, which has a large data amount,is never generated simultaneously in both data streams A and B. Usually,therefore, packet fragmentation is not simultaneously carried out inboth data streams A and B. Thus, when picture data of the data stream A,for example, is fragmented, the packet of the data stream B may becontinuously transmitted immediately after the first packet of the datastream A is transmitted.

The reference value D1 specifying the data amount to be carried by onepacket can be changed as desired. Accordingly, the data transmissionamount can be controlled appropriately taking account of the performanceof the data transmission device 110 itself as well as the capacity andcommunication state of the intranet 310 to which data is transmitted.

Thus, in the embodiment described above, the timings for starting therespective compression/encoding processes are controlled by the videotiming section 118 while at the same time the transmission is controlledby the packet generating section 119 such that fragmented packets aregenerated in accordance with the amount of generated data and aretransmitted at equal intervals, whereby variation in the amount oftransmitting data can be easily smoothed without impairing simultaneityof transmitting data.

As described above, in the data transmission device of the presentinvention, the timing control section controls the timings for startingthe compression/encoding processes in the respectivecompressing/encoding sections so as to be offset in units of frame.Accordingly, the compressing/encoding sections generate data streamshaving respective different picture arrangements, and thus, the dataamounts of generated pictures increase and decrease at different timingsin the respective data streams, making it possible to smooth variationin the total amount of data transmitted to the network. Also, the timingcontrol of the timing control section is carried out based onsynchronizing signals detected by the synchronizing signal detectionsection, whereby the device can be simplified in structure. Further, themultiplexing section generates fragmented packets carrying theindividual data streams in accordance with amounts of data generated perunit time by the respective compressing/encoding sections and transmitsthe fragmented packets at equal intervals within the unit time, wherebyvariation in the amount of data transmitted to the network can be madeeven smoother.

The foregoing is considered as illustrative only of the principles ofthe present invention. Further, since numerous modifications and changeswill readily occur to those skilled in the art, it is not desired tolimit the invention to the exact construction and applications shown anddescribed, and accordingly, all suitable modifications and equivalentsmay be regarded as falling within the scope of the invention in theappended claims and their equivalents.

1. A data transmission device for generating a plurality ofcompressed/encoded data of different bit rates from a single videosignal and simultaneously transmitting the compressed/encoded data ontoa network, comprising: a synchronizing signal detection section fordetecting a vertical synchronizing signal and a color synchronizingsignal from the video signal input thereto, wherein the video signalcomprises an NTSC composite signal; a plurality of compressing/encodingsections for compressing/encoding the video signal to generate datastreams of different bit rates, respectively, wherein thecompressing/encoding sections generate data streams having the samesequence of picture types; a timing control section for controlling saidcompressing/encoding sections in accordance with the detectedsynchronizing signal such that timings for starting compression/encodingprocesses in said compressing/encoding sections are shifted from oneanother in units of frame; and a multiplexing section for sequentiallymultiplexing the data streams generated respectively by saidcompressing/encoding sections and transmitting the multiplexed data ontothe network, wherein the timing control section causes one of saidcompressing/encoding sections to start the compression/encoding processwhen frame start timing of the video signal derived based on thevertical synchronizing signal coincides with rise timing of achrominance subcarrier signal synchronized with the color synchronizingsignal, and causes a different one of said compressing/encoding sectionsto start the compression/encoding process when the frame start timingcoincides thereafter with fall timing of the chrominance subcarriersignal.
 2. The data transmission device according to claim 1, whereinsaid multiplexing section generates fragmented packets carrying theindividual data streams in accordance with amounts of data generated perunit time by said compressing/encoding sections, respectively, andtransmits the fragmented packets at equal intervals within the unittime.
 3. The data transmission device according to claim 2, wherein saidmultiplexing section sets a reference amount of data to be carried byone packet, and if an amount of data generated by any one of saidcompressing/encoding sections during a data generation periodcorresponding to one frame exceeds n times (n is an integer greater thanzero) the reference amount, said multiplexing section fragments andcarries the generated data into (n+1) fragmented packets each having adata amount equal to or smaller than the reference amount andsequentially transmits the fragmented packets at equal intervalsobtained by equally dividing the data generation period by the number ofthe fragmented packets.
 4. The data transmission device according toclaim 3, wherein said reference amount can be set to a desired value. 5.A data transmission method for generating a plurality of data streams ofdifferent bit rates by compressing/encoding a single video signal suchthat data streams generated by compression/encoding have the samesequences of picture types, and for simultaneously transmitting the datastreams onto a network, comprising the steps of: detecting a verticalsynchronizing signal and a color synchronizing signal from the inputvideo signal, wherein the video signal comprises an NTSC compositesignal; shifting start timings for compression/encoding processescorresponding to the generation of the respective data streams from oneanother in units of frame in accordance with the detected synchronizingsignal, wherein one of said compressing/encoding processes is startedwhen frame start timing of the video signal derived based on thevertical synchronizing signal coincides with rise timing of achrominance subcarrier signal synchronized with the color synchronizingsignal, and a different one of said compressing/encoding processes isstarted when the frame start timing coincides thereafter with falltiming of the chrominance subcarrier signal; and generating fragmentedpackets carrying the individual data streams in accordance with amountsof data generated per unit time by the respective compression/encodingprocesses, and transmitting the fragmented packets onto the network atequal intervals within the unit time.